PORTABLE SECURITY PLATFORM 



FIELD OF THE INVENTION 

The present invention relates to security systems and, in particular, to a security system 
including a portable component for accessing security data. 

BACKGROUND 

In known security systems, a variety of security data may be commvmicated to a central 
surveillance location from various security devices. Security personnel who desire access to 
such security data must access the data from the central location. This inhibits their ability to 
investigate incidents in person and to be timely notified of various occurrences. For example, 
security personnel who wish to view live or recorded video from a security camera must do so at 
the central surveillance location. 

Accordingly, there is a need for a security system having a portable component enabling 
a user to efficiently receive and evaluate security information from various systems of a security 
network. 

SUMMARY OF THE INVENTION 

According to one aspect of the invention there is provided a security system including: a 
camera configured to generate a video signal; an object recognition system coupled to the camera 
and configured to receive the video signal; and a portable personal digital assistant (PDA) 
wirelessly coupled to the object recognition system and the camera. The PDA may display video 
from the camera and/or data or alarms in response to output from the object recognition system. 



According to another aspect of the invention, there is provided a method of providing 
security information. The method includes: generating live video of a surveillance area; 
communicating the live video via a wireless connection to a portable personal digital assistant 
(PDA); and displaying the live video on the PDA. According to yet another aspect of the 
5 invention there is provided a method of providing security information including: operating a 
camera to capture an image of an object; comparing data representative of the object with stored 
data; and providing a signal to a portable digital assistant (PDA) in response to the comparing 
step. 



10 BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the present invention, together with other objects, features 
and advantages, reference should be made to the following detailed description which should be 
read in conjimction with the following figures wherein like numerals represent like parts: 

FIG. 1 is block diagram of an exemplary security system consistent with the invention 
1 5 having a portable personal digital assistant (PDA) wirelessly connected to a network having a 
video recorder and an object recognition system; 

FIG. 2 is a block diagram of the PDA of FIG. 1 ; 

FIG. 3 is a plan view of the PDA of FIG. 1 illustrating exemplary control, data, and video 
areas of an exemplary output video screen of the PDA; 

20 FIGs. 4A and 4B are flow charts of exemplary methods of operation of the PDA of FIG. 

1; 
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FIG. 5 is a flow chart of an exemplary method of operation of the object recognition 
system of FIG. 1; and 

FIG. 6 is a flow chart of an exemplary method of operation of the video recorder of FIG. 

1. 

DETAILED DESCRIPTION 

For simphcity and ease of explanation, the present invention will be described herein in 
connection with various exemplary embodiments thereof. Those skilled in the art will recognize, 
however, that the features and advantages of the present invention may be implemented in a 
variety of configurations. It is to be vmderstood, therefore, that the embodiments described 
herein are presented by way of illustration, not of limitation. 

FIG. 1 is a block diagram of an exemplary security system 100 consistent with the 
invention. In general, the security system 100 may include a portable personal digital assistant 
(PDA) 112 wirelessly connected to a network 117 through an access point 114. The network 
117 may include a variety of components and systems including, but not limited to, a camera 
104, an object recognition system 106, a video recorder 108, and other peripheral devices 140, 
e.g. an access control system, metal detector, alarms, etc., that commxmicate with the PDA 112 
as further detailed herein. Those skilled in the art will recognize that the portable PDA 112 may 
be wirelessly connected to the network 1 17 in a variety of ways, e.g., through communication of 
electromagnetic signals between antennas, by an infra red link, etc. In one embodiment, an 
antenna 178 on the PDA 112 may transmit and receive data from the antenna 180 of access point 
114 fimctioning as a wireless transceiver. 

The camera 104 takes video of a surveillance area 110. The surveillance area 110 may be 
an exit/entrance of a retail store, an area aroimd a cash register, an area around a protected asset. 



etc. The camera 104 may be oriented in a fixed direction or a camera position controller 132 
may be coupled to the camera 104 for adjusting the pan-tilt-zoom of the camera and/or to 
position the camera at various viewing angles. The camera position controller 132 may also be 
responsive to control signals fi-om the PDA 112 so a user of the PDA can adjust the pan-tilt- 
5 zoom of the camera 104 as desired. The live video fi-om the camera 104 may be communicated 
via path 127 to the object recognition system and via path 129 to the video recorder 108. Those 
skilled in the art will appreciate that the live video from the camera 104 may be conmiunicated to 
the object recognition system 106 and video recorder 108 in a variety of ways, e.g., through 
network cables or a wireless connection. 

10 The object recognition system 106 is configured to recognize any variety of objects 

entering the surveillance area 110, In general, the object recognition system 106 may receive 
live video from the camera 104 and analj^e the video to detect if an object has entered the 
surveillance area 110. The object recognition system may compare data representative of the 
detected object with data representative of a plurality of known objects to ascertain if an 

15 acceptable correlation exists. Those skilled in the art will recognize that the object recognition 
system 106 may include a computer 116 provided in a variety of known configurations to 
analyze the live video from the camera 104. 

The video recorder 108 may be any of a variety of known video recorders such as a 
digital video recorder. The video recorder 108 may also have internal memory 182 for storing a 
20 recorded video segment of the live video from the camera 104 as fiirther detailed herein. 

In the illustrated exemplary embodiment, the PDA 1 12 is a portable hand-held computing 
device having a variety of known components. FIG. 2 is a block diagram of an exemplary 
portable PDA 112 consistent with the invention. In general, the PDA 112 may include a 



4 



processor 202, a power soxirce 204 (e.g., a rechargeable battery), user input devices 206 (e.g., 
user input buttons, a keyboard, a touch screen, etc.), a video display screen 208 (e.g., LCD 
display which typically also includes a touch screen), machine readable media 210, an audio 
device 212, and data collection devices 222 (e.g. bar code scanner, digital camera, proximity 
5 card detector, etc.). 

The processor 202 may be any type of processor capable of providing the speed and 
functionality required by the embodiments of the invention. For example, the processor 202 may 
be a processor from the Pentium® family of processors made by Intel Corporation, or the family 
of processors made by Motorola. Machine-readable media 210 includes any media capable of 

10 storing instructions adapted to be executed by a processor. Some examples of such media 
include, but are not limited to, read-only memory (ROM), random-access memory (RAM), 
programmable ROM (PROM), erasable programmable ROM (EPROM), electronically erasable 
programmable ROM (EEPROM), dynamic RAM (DRAM), and any other device that can store 
digital information. The instructions may be stored on the medium in a compressed and/or 

1 5 encrypted format. 

The PDA 1 12 is equipped for wireless communication with other components of the 
network 117. Such wireless communication may take place in a variety of ways known to those 
skilled in the art. For instance, such communication may take place through communication of 
electromagnetic signals between antennas. In this instance, the PDA 112 may have an antenna 
20 1 78 and transceiver 216. The PDA may also have an infrared port 21 8 for commxmication via an 
infra red link. 

Advantageously, the PDA 1 12 is configured for bi-directional communication over a 
wireless interface with the network 117. In one exemplary mode of operation, live video of a 
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surveillance area 1 10 is provided to the computer 1 16 of the object recognition system 106. The 
computer 116 analyzes the live video to detect if an object, e.g. a person, has entered the 
surveillance area 110. If an object is detected, the object recognition system 106 provides a 
detection signal. In response to the detection signal, the video recorder 108 may begin recording 
5 live video from the camera for a predetermined time interval to create a recorded video segment. 

The computer 116 may compare a digital representation of the detected object, e.g. a 
digital representation of a person's face, with a plurahty of stored digital representations of 
identified or known objects. A database of identified or known objects may be stored in a 
memory accessible through the network, e.g. in a memory local to the object recognition system. 
10 If a proper correlation is made between the detected object and the stored object, the object 

recognition system 106 may provide an identification signal to the video recorder 108 and to the 
PDA 112. 

In response to the identification signal, the PDA 112 may provide an alarm signal, e.g., 
via the audio device 212 and/or video display 208, to alert a user of the PDA 1 12 that the object 

15 recognition system has identified an object. Also, the video recorder 108 may save the recorded 
video segment, e.g., in a memory 182 of the video recorder. Otherwise, the video recorder 108 
may delete the recorded video segment if the object recognition system did not correlate the 
detected object with a stored object. In addition, a user of the PDA 112 may utilize various user 
input devices 206 to provide a conmiand signal to the video recorder 108 for retrieval of the 

20 recorded video segment. 

For instance, when the object recognition system 106 is a facial recognition system, the 
system 106 may establish a digital representation of one or more faces identified from the live 
video provided by the camera 104. Such a digital representation of the detected person's face 
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may be developed in a variety of ways known in the art, e.g. by analyzing various points and 
distances on a person's facial features such as the distance between eyes, width of nose, etc. The 
computer 1 16 may compare the digital representation of the detected face with various digital 
representations from known persons stored in a database of the computer 116. If an acceptable 
5 correlation between the detected facial image and a stored facial image is made by the computer 
116, the facial recognition system may then notify the video recorder 108 and the PDA 112. The 
facial recognition system may then provide data associated with the detected person to the PDA 
112, e.g., an image file of that person and/or various other data related to the detected person. 

A security person using the PDA 112 may provide a command signal to the video 
10 recorder 108 using any variety of input devices 206 such as via input buttons or a control area 
302 (FIG. 3) of a touch screen portion of the PDA 112, etc. In response, the video recorder 108 
may provide the recorded video segment for that particular object, e.g., for a particular person. 
Such recorded video segment may be played back in the video area 304 of the video display 
screen of the PDA 1 12. 

15 The security person may thus have efficient access to data on the object entering the 

surveillance area via the PDA. In addition, the security person may review live video on the 
PDA of the surveillance area and/or a recorded video segment of the object as it entered the 
surveillance area. Data related to a known object, e.g., an image file of a known person and/or 
other pertinent data related to the person, may be provided by the object recognition system 106 

20 to the PDA 112 and displayed in a data portion 306 of the display screen. This enables the 

security person to have information efficiently available for determining a course of action, e.g., 
taking added precautions with a potential threatening person, making special accommodations 
for a particular person, etc. 
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Those skilled in the art will recognize that a variety of peripheral devices 140 may be 
coupled on the network 1 17 for wireless communication with the PDA 1 12. For instance, the 
peripheral device 140 may include an access control system. The camera 104 may be directed to 
an entrance outside a secure area. The access control system may automatically permit entrance 
5 to the secure area once an object has been recognized by the object recognition system. The 
PDA may be notified by the object recognition system if an authorized object entered the secure 
area and may also be notified if an unauthorized object attempted entry to the secure area. The 
PDA may notify the user of the PDA with associated alarm signals in such instances. 

When the object recognition system is a facial recognition system, such an access control 
10 system may be used to identify authorized persons. If an authorized person is identified, an 

actuator of the system may be triggered to unlock a secured entrance thus allowing access to the 
authorized person. In addition, a signal may be sent to the PDA to notify the user of the PDA of 
the identity of a particular person who entered the secure area. If the facial image is not 
recognized by the facial recognition system or recognized as being associated with unauthorized 
15 personnel, access to the secured area may be denied by maintaining the secured entrance in a 
locked position. The PDA may then notify the user with a distinctive alarm signal in such an 
instance. The video recorder may also be configured to save recorded video segments of any 
failed attempts to enter the seciu-e area. The user of the PDA can then also review the recorded 
video segment of the failed attempt to enter the secure area to decide what, if any, action is 
20 required. 

Another peripheral device 140 that may be coupled to the network 1 17 is a metal 
detector. The metal detector may monitor access to a secure area for any persons carrying 
concealed metal, e.g., a concealed metal weapon. If the metal detector is activated, an alarm may 
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be activated. In this instance, a signal may also be provided to the PDA indicating the metal 
detector alarm has been triggered. In addition, a detection signal may be sent to the video 
recorder indicating a person is about to enter the metal detector. In response, the video recorder 
may begin to record the live video from the camera. If the metal detector is not triggered, the 
5 recorded video segment or some portion thereof may be erased or discarded. If the metal 

detector is triggered, the recorded video segment may be saved. As such, a user of the PDA may 
instruct the video recorder to provide the recorded video segment associated with a particular 
metal detection so that the user can review how the subject was acting before and during the 
metal detection. 

10 Yet other peripheral devices 140 that may be coupled to the network 117 include any 

variety of building sensors such as burglar alarms, fire alarms, smoke detectors, etc. These 
devices may provide a user of the PDA with an immediate indication of a potentially dangerous 
situation. 

The PDA 112 may also be equipped with a variety of data collection devices 222 for 
1 5 supporting additional functionality. The data collection device 222 may include, for example, a 
handheld portable bar code scanner. The bar code scanner may be provided in a variety of 
knovra configurations such a pen-type, CCD, laser or camera based systems. A user may use the 
combined PDA/bar code scanner to track people and merchandise. A user may use the combined 
portable PDA/bar code scanner to scan a bar code on an item and transmit a signal representative 
20 of the bar code to a processor on the network 117. In response to the transmitted signal, asset 
information related to the scanned item may be accessed, e.g., from a database, and such asset 
information may be transmitted back to the combined portable PDA/bar code scanner. 
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In another example, the data collection device 222 may include a known proximity card 
detector. The proximity card detector may be used for validating security badges. In addition, 
the data collection device 222 may include a small digital camera for capturing an image of an 
object, e.g. of a person. The captured image may be sent by the PDA to the object recognition 
5 system, for acquiring data related to the person, e.g. to confirm that the person is authorized to be 
in the area. 

In addition, if the object recognition system is facial recognition system, known persons 
can be grouped in various categories. For instance, persons may be grouped into desirable and 
undesirable categories. If a recognized person is a desirable person, a user of the PDA would be 
10 notified as such. In this instance, special accommodations may then be made for this desirable 
person. In contrast, if a recognized person is an undesirable person, the user of the PDA would 
be notified as such. The user may then review the actions of the person by reviewing the 
recorded video segment of such person. Appropriate action may then be taken by secxirity 
personnel in such instances depending on the identity of the person and their actions. 

15 Turning now to FIG. 4A, a flow chart 400 of an exemplary method of operation of a PDA 

112 consistent with the invention is illustrated. The flow charts used herein to describe various 
embodiments include particular sequences of steps. It can be appreciated, however, that the 
sequence of steps merely provides an example of how the general functionality described herein 
may be implemented. Further, each sequence of steps does not have to be executed in the order 

20 presented unless otherwise indicated. 

In step 402, the PDA 112 receives and displays live video taken by the camera 104. Such 
live video may be displayed in the video area 304 of the video display of the PDA 112. While 
displaying live video, the PDA waits for an identification signal from the object recognition 
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system (ORS) in step 404 indicating that an object that entered the surveillance area 110 was 
recognized or identified as being sufficiently correlated with a known object. If such an 
identification signal is not sent from the object recognition system in step 406, the PDA 
continues to display live video and waits for such an identification signal from the object 
recognition system. 

If an identification signal is received from the object recognition system indicating a 
recognized object, the PDA then receives data associated with the known object and such data 
may be displayed in the data area 306 of the video display. For instance, when the object 
recognition system is a facial recognition system the data may include an image file of the 
known person's face. An alarm signal may also be provided by the PDA in response to the 
identification signal from the object recognition system to signal the user of the PDA that a 
known object has been recognized. The alarm signal may be output in a variety of ways known 
in the art including an audible alarm output the audio device 212, a visual alarm output the video 
display screen 208, or a motion alarm (e.g., vibration of a portion of the PDA), etc. The 
operation of the PDA may then cycle back and wait for another identification signal. 

FIG 4B is a flow chart 450 illustrating another exemplary method of operation of the 
PDA 112. In step 402, the PDA 112 receives and displays live video taken by the camera 104. 
The PDA may send a playback request to the video recorder 108 in step 412 as prompted by a 
user of the PDA, e.g., by utilizing the control area 302 of the video screen. The video recorder 
108 then retrieves the appropriate playback video segment and provides it to the PDA 112. If the 
playback video segment has arrived, the PDA may then stop playing live video 416 and instead 
display the playback video 418 in the video area 304 of the display screen. If the playback video 
stream is finished 420 then live video may be displayed 422 and the PDA waits for another 
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playback request. Alternatively, the video area 304 of the display screen may be parsed into two 
separate areas enabling both viewing of live video and playback video. As such, the starting and 
stopping of live video would not be necessary. 

Turning to FIG. 5, a flow chart 500 illustrating operation of an exemplary object 
recognition system 106 is illustrated. The object recognition system monitors live video in step 
504. If an object is detected, the object recognition system sends a detection signal to the video 
recorder in step 508. The detection signal may be sent in a variety of ways over any of a variety 
of a transmission media. Such transmission media may include a hardwire connection 1 52 
between the object recognition system 106 and the video recorder 108 or a wireless network 
connection between the systems. If an object is not detected, the system continues to monitor the 
live video. 

Once an object has been detected, the system compares data representative of the 
detected object with stored data representative of known objects. If the detected object is not 
correlated with known objects in step 510, the object recognition system continues to monitor the 
live video. If the detected object is correlated with a known object, the object recognition system 
sends an identification signal to the PDA 112 and the video recorder 108 in step 512. In 
addition, the object recognition system may send data, e.g., an image file of a person's face when 
the object recognition system is a facial recognition system, related to the identified object to the 
PDA 112. 

Turning to FIG. 6, a flow chart 600 illustrating an exemplary operating method of the 
video recorder 108 is illustrated. As the process starts in step 602, the video recorder 108 waits 
for a signal, e.g., a detection signal, fi-om the object recognition system in step 604. The 
detection signal may be indicative of the object recognition system 106 detecting an object in the 
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surveillance area 110. If no detection signal is received, the video recorder continues to wait for 
such signal as in step 604. If a detection signal is received, the video recorder starts to record 
live video, e.g., from camera 104, for a predetermined time interval to create a recorded video 
segment in step 608. 

5 Meanwhile, the object recognition system may compare known objects against the 

detected object to determine if there is any correlation. If the video recorder receives an 
identification signal from the object recognition system indicative of the object recognition 
system identifying the object, e.g., sufficiently correlating the detected object with a known 
object, then the video recorder saves the recorded video segment in step 614. Otherwise, if the 
10 object recognition system cannot identify the object, then the video recorder may erase or discard 
(e.g. not save), the recorded video segment 612. Finally, if a playback of a particular recorded 
video segment is requested by the PDA in step 616, the video recorder may retrieve and send the 
requested recorded video segment to the PDA in step 618. 

Erasing video data when an object is not identified by the object recognition system 
1 5 results in efficient data storage, but in some cases may not result in sufficient stored information 
for investigation of a particular incident. The video recorder may, therefore, be configured to 
continuously store video and to store a time stamp when a match occurs in the object recognition 
system. When it is desired to retrieve the video associated with the match, the video may be 
accessed using the stored timestamp as an index into the continuous stream of recorded video 
20 data. To facilitate display of an accurate representation of the video on the PDA, the timestamp 
should be synchronized to the PDA's clock (or vice versa). 

There is thus provided a security system having a PDA wirelessly connected to a network 
to provide a user of the PDA with efficient access and control of various components and 
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systems of the network. The embodiments that have been described herein, however, are but 
some of the several which utilize this invention and are set forth here by way of illustration but 
not of limitation. It is obvious that many other embodiments, which will be readily apparent to 
those skilled in the art, may be made without departing materially from the spirit and scope of 
5 the invention as defined in the appended claims. 
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